Skip to content

Separate shared runtime and benchmark responsibilities - #32

Open
adrian-prior wants to merge 3 commits into
refactor/workspace-layoutfrom
refactor/shared-runtime
Open

Separate shared runtime and benchmark responsibilities#32
adrian-prior wants to merge 3 commits into
refactor/workspace-layoutfrom
refactor/shared-runtime

Conversation

@adrian-prior

@adrian-prior adrian-prior commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Separate shared contracts, task sources, tuning, and estimator helpers under relarena.core. Keep benchmark loading and final refit/evaluation in the host, and backend definitions with their models.

Validation: Python 3.11/3.12 tests, pinned pre-commit checks, and wheel/sdist builds.

RDBLearn keeps only its v2 and v2.5 TabPFN recipes, TabPFN-Rel keeps v3 and the hosted backend, and both call the shared fit_tfm with a spec. Core imports torch only inside default_device and falls back to CPU without it.

Stack created with GitHub Stacks CLIGive Feedback 💬

@adrian-prior
adrian-prior added this pull request to stack #36 September 9, 2026 14:52
@adrian-prior
adrian-prior force-pushed the refactor/shared-runtime branch from 7ac8197 to dcc1360 Compare September 11, 2026 10:05
@adrian-prior
adrian-prior marked this pull request as ready for review September 11, 2026 12:14
adrian-prior and others added 2 commits September 11, 2026 16:19
RDBLearn keeps the v2 and v2.5 recipes it sweeps, TabPFN-Rel the v3 and hosted
recipes, and both call the shared fit_tfm with a spec instead of a name wrapper.
core.tfm imports torch only inside default_device.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using high effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit b72b987. Configure here.


import numpy as np

from relarena.core.tfm import TFMSpec

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Example imports removed default_device

Medium Severity

Removing the local fit_tfm wrapper also dropped the module-level default_device binding from relarena.models.tabpfn_rel.tfm. The documented caching example still imports default_device from that module, so it now fails immediately with ImportError before any cache comparison runs.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit b72b987. Configure here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant